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Abstract 

We establish a region of convergence for the proto-typical non-convex Douglas- 
Rachford iteration which finds a point on the intersection of a line and a circle. Previous 
r \ • work on the non-convex iteration [2] was only able to establish local convergence, and 
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was ineffective in that no explicit region of convergence could be given. 



The Douglas-Rachford algorithm is an iterative method for finding a point in the intersection 
of two (or more) closed sets. It is well-known that the iteration (weakly) converges when it is 
applied to convex subsets of a Hilbert space (see e.g. [1, Fact 5.9] and the references therein). 



OS ' Despite the absence of a theoretical justification, the algorithm has also been successfully 



applied to various non-convex practical problems, see e.g. [4, 6]. 

An initial step towards providing some theoretical explanation of the convergence in the 
non-convex case can be found in [2], where the authors study a prototypical non-convex 
two-set scenario in which one of the sets is the Euclidean sphere and the other is a line (or 
more generally, a proper affine subset). Similar to the convex case, Borwein and Sims prove 
local convergence of the algorithm to a point whose projection into any of the sets gives a 
point in the intersection, whenever the sets intersect at more than one point and to a point 
outside the set in the tangential case (otherwise, the scheme diverges). Our aim herein is to 
extend their local result to a global one. 

Given two closed subsets A and B of a Hilbert space X, the Douglas-Rachford scheme 
consists of first reflecting the current iteration in one of the two sets, then reflecting the 
resulting point in the other set, and then taking the average with the current iterate to form 
the next step (see Figure 1). The reflection of a point x G X in the set A can be defined as 

R A (x) := 2P A {x) - x, 
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Figure 1: Construction of the next iterate of the Douglas- Rachford scheme when applied to 
a sphere S and a line L. 

where Pa{%) is the closest point projection of the point x in A, that is, 



Pa{x) '■= { z E X : \\x — z\\ — inf llx — a\ 

I aeA 

In general, the projection P A : X =$ A is a set-valued mapping. 

If A is convex, the projection is uniquely defined for every point in X, thus yielding a 
single- valued mapping (see e.g. [3, Theorem 4.5.1]). The Douglas-Rachford iterative scheme 
is defined as 

x n+ i := T A>B (x n ), (1) 

with Ta,b '■= \{RbRa + I), where I is the identity map. Therefore, when the sets A and 
B are both convex, the iteration (1) is uniquely defined. Furthermore, if A fl B ^ 0, the 
sequence is weakly convergent to a fixed point x of the mapping Ta,b- Then, one can obtain 
a point in the intersection of A and B by projecting the point x in the set A, since 

Ta, b [x) = x ^^ x = 2P B (2P A (x) -x)- 2P A (x) + x 
^ Pa(x) = P b (2Pa(x)-x), 

which implies Pa(%) E An B. 

Weak convergence of the algorithm comes from the fact that the projection mapping is 
firmly nonexpansive, that is, 

\\P A (x) - P A (y)\\ 2 + \\{I- P A )(x) -(I- P A )(y)\\ 2 < \\x - y\\ 2 , for all x,y e X, 

see e.g. [5, Theorem 12.2], which implies that the reflection map is nonexpansive, 

\\Ra(x) - R A (y)\\ < \\x-y\\, for allx,y E X, 



whence, T^b is firmly nonexpansive, see e.g. [5, Theorem 12.1] or [7, Lemma 1], and this 
implies the weak convergence of the iterative scheme (1), see [8, Theorem 1]. 

As in [2], we restrict our study to the non-convex case of the intersection of a sphere 
S := {x G X: ||x|| = 1} and a line L :— {x = Xa + cub: A G R} where, without loss 
of generality, one can take ||a|| = ||6|| = 1, with a orthogonal to b, and a > 0. If X 
is iV-dimensional, and (x(l),x(2), . . . ,x(N)) denotes the coordinates of x relative to an 
orthonormal basis whose first two elements are respectively a and b, the Douglas-Rachford 
iteration (1) becomes, 



y n ■ 



X n+ i(l) = X n (l)/p n 

x n+1 (2) = a + (1 - l/p n )x n (2), and (2) 

x n +i(k) = (1 - l/p n )x n (k), for k = 3, . . . , N, 



where p n := ||x n || := yi n (l) 2 + . . . + x n (N) 2 , see [2] for details. Borwein and Sims prove 
the next local convergence result. 

Theorem 1.1 ([2, Theorem 2]). If < a < 1 then the Douglas-Rachford scheme (2) is 
locally convergent at each of the points ±\/l — ct 2 a + ab. 

Moreover, Borwein and Sims also conjecture the following: 

Conjecture 1.2 ([2, Conjecture 1]). In the simple example of a sphere and a line with two 
intersection points, the basin of attraction is the two open half-spaces forming the complement 
of the singular manifold (x, a) = 0. 

Our main objective is make progress on Conjecture 1.2. We shall follow an algebraic 
approach, and in order to avoid an even more involved analysis 

we restrict our current study to the case where N = 2 and a = l/v2. 

This case is enough to expose all of the difficulties in establishing Conjecture 1.2. Similar 
proofs can be obtained for all other cases, although we believe that a different non-algebraic 
approach is needed to provide simpler proofs for the general case. 

2 Convergence 

In order to ease the notation, we shall denote the coordinates of the current iteration with 
respect to the orthonormal basis {a, b} by (x n , y n ). Then the iteration (2) for N = 2 becomes 

x 

X n +1 = — = COsd n = p n+1 COs8 n+l , 

y n+1 = a + \1 - —J y n = y n + a - sm9 n = a + (p n - 1) sm9 n = p n+1 sin0 n+ i, 

where p n = \Jx\ + y\ and 9 n is the argument of (x n , y n ). Throughout this section we assume, 
as we indicated, that a = l/v^, m which case the sphere S and the line L intersect at the 
points (a, a) and (—a, a). (Geometrically, this appears totally general. Algebraically, we 
have been unable to show this.) 



On one hand, observe that whenever the iterations lie outside the sphere, the algorithm 
behaves as if the sphere was a ball, and therefore the mapping T$ ,l is nonexpansive. On 
the other hand, when the iterations lie inside the ball, the mapping Tg t L can be expansive. 
Despite this, we will show that the contractive behavior of the sequence in some regions 
overcomes the expansive behavior occurring in other areas, and the sequence generated does 
converge. It is this oscillatory behaviour which demands better understanding. 

Because of symmetry we will need analyze the case when xq > 0, where we will show that 
the sequence converges to the point (a, a). We thus study the behavior of the iterations in 
seven different regions, see Figure 2. 



P :={(x,y)eR 2 \y<0<x} 



Pi :={{x,y) G 
P 2 :={(x,y) G 



x 



X 



y 2 < 1 and < y < x} 
y 2 > 1 and < y < a} 



P 3 :={(x,y)eR 2 \a<y<x} 



Pa ■= {(x,y) G it 



2 + y 2 > 1 and < x < y} 




P 5 := {(x, y) G M 2 | x 2 + y 2 < 1, x > and y > a} 
P 6 : = {( x , y) G M 2 | < x < y < a} 



Figure 2: Different regions in the half-space x > 0. 

Our main result reads as follows. 

Theorem 2.1. If(x ,y ) E [e, l]x[0, 1], withe := (l - 2~ 1/3 ) 3/2 w 0.0937, then the sequence 
generated by the Douglas- Rachford scheme (3) with starting point (xq, yo) is convergent to 
the point (a, a). 

In order to prove Theorem 2.1, we will show that the sequence is convergent to (a, a) 
whenever the initial point (xo,yo) € P\. The next step will be to prove that the sequence 
hits the region P\ after a finite number of iterations, when (xq,2/o) belongs to the other 
demarcated areas. This will imply the convergence. In order to demonstrate convergence 
within the region Pi, we will analyze the behavior of the iterations within each of the 
other regions. We will show that the iterations pass through the different regions in a 
counterclockwise way. We begin with the region P : the next proposition shows that the 
sequence must eventually abandon the region P . 



Proposition 2.2. If (x n , y n ) G Pq then y n +k > for some k G N. 



Proof. If y n+m = for some m = 0, 1, 2, . . ., then y n + m +i 
Suppose by contradiction that y n +k < for all k — 0, 1, 2, 



> y n +k+i = a + ( 1 - 



1 ' 

Pn+k. 



= a, and we can take k 
. . . . From 

Vn+ki 



772+1. 



we deduce that p n +k > 1 for all k = 0, 1, Thus 

_ X n +k 
Xn+k+1 ^ -^n+fc; 

Pn+k 

for all k = 0, 1, . . ., and therefore the sequence x n+ k is convergent to some x*; whence, p n+ k 
is convergent to 1. Since 

Vn+k+i = a + (Pn+k - 1) sin0 n+fc , 

one has that the sequence y n +k is convergent to a, a contradiction with the assumption 
y n+k < for all k — 0, 1, 2, □ 

Remark 2.3. If yo = then po = ^o? an ^ £/ms, (a?i,2/i) = (1,«) G P 2 . It is possible to 
compute symbolically the sequence and check that (xQ,yo) G P\. 

In the region Pi U P 2 U P 3 the sequence gets closer after each iteration to the intersection 
point (a, a), and after one or at most two iterations it jumps to the next region. 

Lemma 2.4. If (x n , y n ) G Pi U P 2 U P 3 then 

\(x n+1 ,y n+1 ) - (a,a)\ 2 < -\(x n ,y n ) - (a,a)\ 2 . (4) 

Moreover, we have the following: 
(i) if (x n , y n ) G Pi then (x n+2 , y n +2J G P 2 U P 3 U P 4 ; 
(ii) if (x n , y n ) G P 2 then (x n+1 , y n+1 ) G P 3 U P 4 ; 
(iii) if(x n ,y n ) G P 3 then (x n+ i,y n +i) G P 4 . 

Proof. To prove (4) notice that 

2 [(x n+ i - a) 2 + (y n+1 - a) 2 ] = 2(cos0 n - a) 2 + 2{y n - sin# n ) 2 

= 2(cos 9 n - a) 2 + 2(p n - l) 2 sin 2 9 n 

= 2 cos 2 n - 4a cos n + 2a 2 + 2 sin 2 6 n + 2p n (p n - 2) sin 2 6>„ 

= 3 — 4(a cos n + p n sin 2 n ) + 2p 2 sin 2 9 n , 



and also 



(x„ - a) 2 + (y n - a) 2 = (p n cos n - a) 2 + (p n sin n - a) 2 

= p n cos 2 6 n — 2a p n cos # n + a 2 + p 2 sin 2 9 n — 2a p n sin 6 n + oi 2 
= 1 + p 2 - 2ap„(cos 9 n + sin n ). 

Thus (4) holds if and only if 

2 — 4(a cos 6 n + p n sin 2 n ) + 2p 2 sin 2 n — p 2 + 2ap n (cos 6* n + sin 6 n ) < 0, 
or, equivalently, 
f(p n ,8n) := (2sin 2 # n - l)p 2 - (4sin 2 ^ - (sin0 n + cos0 n )V2)p re -2V2cos0 n + 2 < 0. (5) 



If 9 n = 7r/4, then (5) holds with equality. 

We will now prove that f(p n ,9 n ) < for all p n G [0, 1] and 9 n G [0,7r/4). Observe that 
/(0, 9 n ) = 2 - 2\/2cos 6> n < for all 9 n G [0, 7r/4). On the other hand, notice that f(p n , 9 n ) 
is a quadratic function in terms of p n , whose leading coefficient 2 sin 2 6 n — 1 is nonzero. Its 
discriminant is equal to 

16 sin 4 9 n - 8^ sin 3 6 n + 8 (v^cos 6 n - 2) sin 2 6 n + 4 sin # n cos n - 8^2 cos n + 10. (6) 

If we make the substitution w := sin9 n , then (6) becomes 

16w 4 - 8V2w 3 + 8 (Vl-w 2 V2 - 2) w 2 + 4Vl - w 2 w - %y/l-w 2 y/2 + 10. 

Hence, the discriminant is equal to zero if and only if 

16u> 4 - 8V2w 3 - 16w 2 + 10 = -4Vl-w 2 (2V2w 2 + w - 2^). 

Taking squares of both sides and dividing by 4, we get 

64w 8 - 6AV2w 7 - 64w 6 + 80V2w 5 + 52w A - 72y/2w 3 + 12w 2 + 16V2w -7 = 0. 
The roots of the latter equation are 

-U\]-2V2 + l + V2+l\V2, U\J-2V2 + l-V2-l\V2, 

~ N2V2 + 1 - V2 + 1 J V2, ^y / 2V2>l + v / 2-l)v / 2, -^=. 

The first two roots are complex numbers, the third one is negative, and the fourth one 
is greater than \j\/2. Remembering that w = sin# n , with 9 n G [0,7r/4), we have that 
w G [0, I/a/2). When 9 n = 0, the discriminant (6) is equal to — 8-\/2 + 10 < 0; whence, (6) 
is always negative for all 9 n G [0,7r/4). Therefore, f(pm9 n ) < for all p n G [0,1] and 
9 n G [0,7r/4], which completes the first part of the proof. We turn to the second part. 

To prove (i), notice first that 9 n G (0,7r/4], since x n G P\. Then x n+ \ = cos9 n G [a, 1) 
and 

y n+1 = a + (p n - l)sin0 n G [0,a). 



Furthermore, 



xl+2 + vl+2 = ^ + « 2 + ( 1 - — ) t/ 2 + 1 + 2« ( 1 ] y n+: 

Pn+1 \ Pn+1 J V Pn+1 

If. 2 \ 2 _ /. 1 



2 V Pn+1/ V Pn+1, 

1 + 2/n+l + ^F 2/n+l 



v2/ V V Pn+i / v2 



Thus, x„ +2 + Vn+2 > 1 if an d on ly if 



y - +1 ' i^r) < 7i- (7) 



On the other hand, p n+ i > a/1/2 + 2/^ +1 , which implies that 

( 2-p n+1 \ (2-y/l/2 + y* +1 

Vn+1 < Vn+1 



Pn+1 J ' V V 1 / 2 + Vn+1 

Hence (7) holds if 



**' ' ^ + «t» J * vi' (8) 

or, equivalently, 

-y / 2y2 +1 + lv^yn+i + 4y n+1 < y / 2 2 /2 +1 + 1. 

Taking ty := a/2^ +1 + 1 G [1, a/2), the above inequality becomes 

(-w + 2V2\ Vw 2 - 1 < w. 
Squaring both sides we obtain 

w A - 4 v / 2w 3 + 7w 2 + 4V2w - 8 < w 2 , 

that is, 

w A - AV2w 3 + Qw 2 + AV2w - 8 < 0. 

Finally, notice that 

w 4 - 4V2w 3 + 6w 2 + AV2w - 8 = (w - V2) (w - \[2 - Vo) (w-y/2 + Vo) < 0, 

since w E [1, \/2). Therefore (7) holds, whence (x n +i,y n +i) G P2 U P3 U P4, and the proof 
of (i) is complete. 

To prove (ii), observe that 

Vn+i = a + ( 1 )y n > a, 

V PnJ 

since p n > 1 and y n > 0. Moreover, by a similar argumentation as above, we have that 

4« + An = 1 + (v. + ^) (* (^) + ^) ■ 

Hence, x 2 n+1 + y^ +1 > 1 if and only if 

± >yn (^-P^=(2-p n )sm6 n , (9) 
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which holds since sm9 n G (0, a) and p n > 1. Therefore (x n+ i,y n+ i) G P3 U P 4 , as claimed. 

To prove fm), if (x n ,y n ) G P3, we have again x^ +1 + y^+i > 1 because of (9), since 
sin# n G (0, a] and p n > 1. Furthermore, 

x n+ i - y n+ i = cos6> n - a + (1 - p n ) sin6» n . 

Since p n > -£*- and 6* n G (0,71741, we have 

sin t/71 /j 

x n +i ~ Vn+i = (cos 9 n + sin 6> n ) - a - p n sin 6»„ < \pl - la = 0. 
Thus, (x n+ i, y n +i) G P4, and the proof is complete. □ 

In the region P 4 the sequence does not get any farther from the intersection point (a, a), 
and one can show that it jumps to the next region P 5 after a finite number of steps. 

Lemma 2.5. If (x n ,y n ) G P4 then 

I (x n+ i, y n+ i) - (a, a) | 2 < | (x n , j/ n ) - (a, a)\ 2 . (10) 

Moreover, (x n+ i,y n+ i) G P4 U P 5 and i/iere zs some k EN such that (x n+ k,y n +k) G P5. 

Proof. The first part is a direct consequence of the convex case: when the point lies outside 
the sphere, the Douglas-Rachford iteration behaves as it the sphere was a ball; thus, we have 
the nonexpansive bound (10), see e.g. [5, Theorem 12.1] or [7, Lemma 1]. 
For the second part, observe that 

y n+1 - a = (p n - 1) sm9 n > 0, 

since 6 n G (tt/4, 7r/2) and p n > 1. Furthermore, 

x n+x - y n+1 = (cos 6 n + sin 9 n ) - a - p n sin 9 n < \pl - 2/a = 0; 

thus, (x n+ i,y n+ i) G P4 U P 5 . Finally, if (xk,yk) G P4 for all k > n, then p k > 1 and 
6k G (7r/4,7r/2), and hence 

Xk+l Xk 

Xk+2 = < %k+l = <X k < ... <X n , 

Pk+1 Pk 

for all k > n. Similarly, 

yk+2 = 2/fc+i + ot - sin 9 k+l < y k+1 = y k + a - sin 9 k < y k < . . . < y n . 

Therefore, the sequence (x k ,y k ) is convergent, whence p k — > 1, and then (x k ,y k ) —)■ (a, a). 
Nevertheless, 

x k+1 = cos 9 k < a, 

for all k > n; thus, the decreasing sequence x k cannot converge to a, and we obtain a 
contradiction. □ 



In the regions P5 and P$ the sequence gets farther from the point (a, a). Nevertheless, 
the effect is "rather small" compared to the contractiveness of other regions. 

Lemma 2.6. If (x n , y n ) G P5 U Pq then 

\{x n+1 ,y n+1 ) - (a,a)\ 2 < Q - V2 + i^/-20v^+ 2d\ \(x n ,y n ) - (a,a)\ 2 . (11) 

Moreover, we have the following: 
(i) if(x n ,y n ) G P 5 then (x n+1 ,y n+ i) G P 6 ; 

(ii) if (x n , y n ) G P 6 wift a; n > e := (l — 2 -1 / 3 ) « 0.0937 i/ien i/iere zs some fcGN sttc/i 
tfiai (x n+fc ,y n+fe ) G Pi. 



Proo/. Let 77 := (§ - v^ + ±^-2(^/2 + 29) = § - ^2 - ±^-2(^/2 + 29. By a similar 
computation to the one in Lemma 2.4, one can prove that (11) holds if and only if 

f{p n ,6 n ) : = (r]sm 2 e n -l)p 2 n - \2r] sin 2 n - V2(sin 6 n + cos 6 n ))p n 

\/2cos0 n --J?7-l<O, (12) 

for all p n G (0, 1] and 9 n G (vr/4, 7r/2). Again, /(p n , 9 n ) is a quadratic function in terms of p n , 
whose leading coefficient 77 sin 2 9 n — 1 is negative, since 77 < 1. After the change of variable 
w := sin# n , its discriminant is equal to 

2(2w 4 - 3w 2 )r] 2 + Wl - w 2 (V2r] 2 w 2 - V2~(w 2 + 1)77 + w) -2(2V2w 3 - 2w 2 -3)77-2 

Thus, the discriminant is equal to zero if and only if 

2(2w 4 - 3w 2 )ri 2 -2(2V2w 3 - 2w 2 - 3)7/ - 2 = -4Vl - w 2 (V2r] 2 w 2 - V2~(w 2 + 1)77 + w 

Taking squares and collecting the terms in w we obtain 

= lQr] A w 8 - 32 v / 2yV - 16 (?? 4 + 2rf - 477 2 )w 6 + \§(?>\[2rf - 2V2r) 
+ 4(r/ 4 + 8r/ 2 + 4)tx> 4 - IQibV^rj 2 - V2r])w 3 - 8(t? 3 - 5t? 2 + 2r\ + 2) 
+ Z2\f2riw + 4/7 2 - 24r/ + 4. 

By substituting u := V^w, we get 

= 77 V - 4r/V - 2(t/ 4 + 2t/ 3 - 4r/ 2 )u 6 + 4(3t7 3 - 2r/)u 5 + (t/ 4 + 8t/ 2 + 4)tj 4 
- 8(5t7 2 - 77)tx 3 - 4(t7 3 - 5t? 2 + 2t7 + 2)m 2 + 32rra + 4t? 2 - 24t? + 4 

This polynomial has four real roots, of which three are positive: 1 (double) and y/2. There- 
fore, the only roots of the discriminant are a and 1. Since w = sin8 n G (a, 1), we have that 



w 5 



)w 2 



f{p n ,9 n ) has always the same sign for all p n G (0, 1] and 9 n G (7r/4, 7r/2). By checking for 
instance that / (l, §7r) < we complete the first part of the proof. 
To prove (i) observe that 

Vn+l = a + ( 1 I z/ n < a- 

Moreover, 

a^n+i - Vn+i = cos9 n - a + (1 - p n ) sm9 n . 



Since p n G ( -r 9 ^- 

r "■ \ sin 0„ 



, then 

x n+ i — Vn+i < cos 9 n + sin 9 n — 2a < v2 — 2a = 0, 



and we are done, because x n+ i = cos9 n G (0, a). 

Finally, to prove (ii), we begin by showing that if (x n ,y n ) G P6 with x n > e, then 

(x n+ i,y n+ i) G P 6 U Pi with x n+ i > x n > e, for e := (l — 2" 1 / 3 ) . Indeed, observe that 

x n +i = — = cos 9 n G ]x n , a[, 

Pn 

since 9 n G J7r/4, vr/2[ and p n < 1, which also implies, 

Vn+i = Vn + a- sin9 n < y n . 
Furthermore, one has 

y n +\ = a + p n cos 9 n -^ — sin 9 n > a + e tan 9 n — sin 9 n > 0, 

cos 9 n 

since the function g(9) := a + eta,n9 — sin9 is nonnegative when 9 G]7r/4,7r/2[ (it attains 
its minimum at 9 = arcsin(2 -1 / 6 )). If y n+1 = 0, then by Remark 2.3 we have that 
(x n+7 , y n+7 ) G Pi. Otherwise, (x n+1 ,y n+1 ) G P 6 UP X . 

Now assume by way of contradiction that (x n+ k, y n +k) G Pq for all fceN. The sequences 
x n and y n , being bounded and strictly increasing/decreasing (respectively), must converge to 
some points x* and y*. By the definition of the Douglas- Rachford iteration (3) this implies 
that p n converges to 1, and then y* = a, which in turns implies x* = a; that is, the sequence 
(x n+k ,y n+k ) converges to (a, a). Therefore 

a > y n+k > y n+k +i > ...>y* = a, 

a contradiction. □ 

Remark 2.7. The condition x n > (l — 2 -1 / 3 ) in (ii) is required in order to avoid the 
sequence ever again hitting the region Pq, where a more complex (and somehow chaotic) 
behavior occurs. 

The next result shows that the iterations cannot stay above the 45 degrees line for an 
infinite number of steps. 

10 



Proposition 2.8. If(x n , y n ) is a sequence generated by the Douglas- Rachford algorithm, then 
for allm G N there exists some k > m such that Xk > Vk> that is, (xk,Vk) € P0UP1UP2UP3. 

Proof. Assume by contradiction that x n < y n for all n > k. Then 6 n G (tt/4, tt/2) for all 
n > k, and thus, 

y n+ i = y n + a-sin6> n < y n . (13) 

Hence, the sequence y n is strictly decreasing for all n> k, and being bounded from below by 
0, it must converge to some point y*. Then, from (13), one must have that sin9 n converges 
to a. From this we deduce that 6 n converges to n/4. This implies that x n converges to 
a, and then p n converges to 1. Thus, y* = a, and therefore, (x n ,y n ) converges to (a, a). 
Remembering that the sequence y n is strictly decreasing, from Lemma 2.5 and Lemma 2.6, 
we conclude that there is some m G N such that (x n ,y n ) G Pq for all n > m. Being that y n 
strictly decreasing, it cannot converge to a, and we obtain yet again a contradiction. □ 

Now we have all the necessary ingredients to prove that if the initial point lies in Pi, 
the iteration again hits Pi after a finite number of steps, and moreover, the distance to the 
solution (a, a) has by then decreased. 

Theorem 2.9. If(xo,yo) G P\, then there is some m G N such that (x m ,y m ) G P\, with 

\{xk,Vk) ~ (a,«)| 2 < -j\(xo,y ) ~ (a,a)\ 2 < 0.86|(x , y ) - (a,a)\ 2 . (14) 

for all k<m, where 7 := § - v / 2 + |\/-20\/2 + 29. 

Proof. Since #0 G (0, 7r/4], one has X\ = cos ^ £ [ ft 5 1)> an d also 

?/i = ct + (p - 1) sin 6» G [0,a). 
Thus, (xi, ?/i) G Pi U P 2 . By Lemma 2.4 we have (x 2 , 2/2) G P 2 U P 3 U P 4 , and moreover, 

1(^2,2/2) - («,«)| 2 < -|(xi,yi) - (a,a)| 2 < -\(x ,y ) - (a,a)\ 2 . 

Furthermore, by (ii) and (iii) in Lemma 2.4 and also by Lemma 2.5, there is some k G N 
such that (Xk~i,yk-i) £ P5, having 

\(x k -i,yk-i) ~ («,")| 2 < j\(xo,yo) - (a,a)| 2 . 
Finally, by Lemma 2.6, we get 

\(xk,Vk) ~ (a,«)| 2 < -r\(x 07 yo) - (a,a)| 2 , (15) 

and (x k ,yk) £ Ps- Then 

y fc+ i - a = (p fc - 1) sin6> fc < and x k+1 = cos9 k G (0, a), 
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since 9 k G (tt/4, vt/2). Thus, y k +\ < «• On the other hand, y k+ \ > if and only if 

a 



Pk> 1 



sin^t 



which holds if pfc > 1 — a. Because of (15), and taking into account that \(x ,yo) — (a,a)\ < 1, 
one has 

(x k - a) 2 + (y k - a) 2 < J, (16) 



and hence, 



Pk > V2 ( a - J 1 ) -a. 



Therefore, x k+1 G (0, a) and y k+1 e (0,a); whence, (x fc+ i,?/ fc +i) G P 6 U Pi. If (xfc+i,y fc+ i) G 
Pi, then by Lemma 2.6 we have 

7 2 
|(x fe+ i,y fc +i) - (a,a)\ 2 <j\(x k ,y k ) - (a,a)\ 2 < — \(x ,y ) - (a,a)\ 2 , 

which implies (14), and we are done. Otherwise, (x k+ i,y k+ i) G Pq. Since 

_ x k 

Xk+1 — /—r 5-) 

v x i + VI 

one has 

x k+l /-,„n 

%k = i yk, (17) 

because Xfc,?/fc > 0. Then, 

rv4- I 1 - 

\Afc + 2/jfe 



y k+1 = a + ( 1 - ; ,f = \y k = a + y k - \/l- x 2 k+1 , 



and thus, 



j/ fc =y k +i -oc+ \l-x% +1 . 



Now (x k ,y k ) G P6 implies y^ < a; whence, 



: y/2- \ l-x 



yk+i sv^- y-L-^+r 

Since (xfc+i>2/fc+i) G P6, then Xfc +1 ,y fc+ i > 0, and we have (17) and (18) for k + 1 instead of 
fc. Thus, the latter inequality yields 



./. ] 



which implies 



yk+i sv^- t /i- - _ 2 ^ +1 , 

1 x fc+2 



,,2 



(v^-Wh-i) >l-j-^-«2+: 



„2 tffc+1) 

J 'fc+2 
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or, equivalently, 



(v^fc+2 + Vk+i ~ Y 2 ^+2 - 3x t+2 + 1 - V^J [V2x 2 k+2 + y k+1 



24+2 - 3*l +2 + 1 - V2) > 

Hence, one must have one of the following two possibilities: 

y k+1 >V2- V2x 2 k+2 + J2x\ +2 - 3x 2 k+2 + 1, (19) 



Vk+i <V2- V2x 2 k+2 - ^2xt +2 - 3x 2 k+2 + 1. (20) 

Let us show that (19) is not possible. Indeed, Xk+2 = cos 6^+1 e (0, a) since (xk+i, Vk+i) € 
Pq. Thus, 

y/2 - V2x 2 k+2 + ^2x\ +2 - 3x 2 k+2 + 1 > -L + ^2x* +2 - 3x 2 +2 + 1 > a, 

and hence, (19) would imply y fc+1 > a, a contradiction. Therefore, (20) holds, as claimed, 
and using (18) for k + 1 we get 



2/ fc +2 - a + y 1 - x| +2 < V2 - >/2a^ +2 - y / 2^, +2 - 3:r 2 +2 + 1, 

that is, 

2/ fe+2 < ^ v/2 - V2x 2 k+2 - yJl-x 2 k+2 - yj2x 4 k+2 - 3x 2 k+2 + 1. (21) 

Consider the function f(x) := \\f2- \[2x 2 - \f\ - x 2 - a/2x 4 - 3x 2 + 1. 

We now show that f(x) has only one fixed point in (0, a). First, we have f(x) = x if and 
only if 

--V2 + v^x 2 + Vl - x 2 + v 7 ^ 2 - 1) (2x 2 - 1) + x = 0, 
which becomes, after the change of variable a; = z/v2, 



— v / 2 + -v / 2^ 2 + a/ — z 2 + -J — ^ 2 + lV2 + -V2^H- W — z 2 + l = 0, 
2 2 V 2 2V 2 2 V 2 



and multiplying by y/2, 



+ z-3 + V-z 2 + 2^V- 



z 2 + z-3 + V-z 2 + 2( V-z 2 + 1 + 1 



that is, 

z 2 + z-3 = -V-z 2 + 2U/-Z 2 + 1 + l) . 

Taking squares we get 



2 4 + 22 3 - 5z 2 - 6z + 9 = z 4 - 2V-z 2 + l(z 2 - 2) - 4^ 2 + 4, 
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and then, 

2z 3 - z 2 - Qz + 5 = -2y/-z 2 + l(z 2 - 2) . 

Taking squares again we obtain 

4/ - 4z 5 - 23z* + 32z 3 + 26z 2 - 60z + 25 = -4z 6 + 20z 4 - 32z 2 + 16, 

and grouping terms, 

8z 6 - Az 5 - 43z 4 + 32z 3 + 58z 2 - 60z + 9 = 0, 

which is equivalent to 

- 1) (8^ 5 + 4z 4 - 39^ 3 - 7z 2 + 51z - 9) = 0. 

By Sturm's theorem, the polynomial 82 s + 4z 4 — 39 z 3 — 7z 2 + 51z — 9 has only one root z 
in the interval (0, 1), which can be numerically computed: 

z « 0.186012649543. 

Therefore, f(x) has a unique fixed point x in (0, a), with 

x^ 0.131530805878. 

In particular, f(x) < x for all x G (0.14, a). Thus, by (21), if x k+ 2 £ (0.14, a), one has 
Vk+2 < /(^fc+2) < ^fc+2- Hence, to show that (xfc+2, y/c+2) £ Pi we only need to prove that 
x k+2 > 0.14, since (x k+1 ,y k+1 ) G P 6 yields x fc+2 < a. 
Observe that (16) implies 



Xu > a — — — =: A; 

fc _ 2 

whence (see Figure 3), 

%k+i = cos9 k > = =: T, 

- V« 2 + A 2 

and similarly, since (xfc+i,yfc+i) G P6, one has 

T 

x k+2 = cos6 k+1 > ^=^= « 0.18124764381 > 0.14, 

V« 2 + T 2 

and hence, (xfc + 2,?/fc+2) G Pi. Finally, by Lemma 2.6, one has 

\(x k+2 ,y k+ 2) - (a,a)\ 2 <-f\(x k+1 ,y k+1 ) - (a,a)\ 2 < — \(x ,y ) - (a,a)\ 2 



and the proof is complete. □ 

The final two preliminary results tell us that the iterations hit Pi after a finite number 
of steps whenever the initial point lies in P2 or P3 (with xq < 1). Hence, convergence on 
starting within these regions will be a consequence of convergence within Pi. 
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0.1 0.2 0.3 0.4 0.5 0.6 0.7 



Figure 3: The point (xk,yk) belongs to the region P 6 , with x k > A. 



Corollary 2.10. If (x ,y ) G P3 with x < 1, then there is some integer k G N such that 
(x k ,y k ) G Pi. 

Proof. Notice first that 

\(x ,y )-(a,a)\ 2 <2(l-a) 2 . 

By Lemma 2.4 we have (xi,yi) G P4, and moreover, 

\(xi,yi) - (a,a)\ 2 < -\(x ,yo) - (a,a)\ 2 . 

By a similar argumentation to the one in the proof of Theorem 2.9, we can find some fceN 
such that (xk,yt) G Pq, having also 



whence, 



\(xk,Vk) - (a,a)\ 2 < -\{x ,yo) - (a,a)\ 2 ; 



\(x k ,yk) - (a,a)\ 2 < 7(1 -a) 2 < -. 



Therefore, we have that (16) holds, and hence, the rest of reasoning in the proof of Theo- 
rem 2.9 remains valid, leading to either (x fc+1 , y fc+1 ) G P\ or (xk+2,Vk+2) £ P- D 

Corollary 2.11. // (xo,yo) G P-i with Xq < 1, then there is some integer k G N such that 

(x k ,y k ) e Pi- 

Proof. From Lemma 2.4(h) we have (xi, yi) G P 3 UP 4 . If (x±, yi) G P3, since X\ = cos9 < 1, 

we can apply Corollary 2.10 and we are done. Otherwise we have x\ < y±. By (17) and (18), 

one has 

xi(yi -a) 



1 > x 
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+ Xi, 



or, equivalently, 

This implies that 
That is, 



l-x 1 > gl( y yi " a) >0. 



^(j/i - a) 2 <(l-xi) 2 (l-x?). 



a-[±--l)^l-xt<y 1 <a+^--l} X /l-xi. 

Moreover, since yo < a, from (18) we get 

a>yo = yi-a+ \fl-x'i, 
and hence, 



j/i < 2a- yl-xf. 

Consider the functions /(x) := a+(l/x — 1) a/1 — £ 2 and g(x) := 2a — a/1 — x 2 for a; G (0, 1) 
One has f(x) = g(x) if and only if x verifies the equation 



^fl^x 2 

= a, 



x 



whose unique solution in (0, 1) is x = a/2/3, with f(x) = g{x) = a/2 — 1/a/3 =: y. Observe 
that / is strictly decreasing in (0, 1), while g is strictly decreasing, since 

f'(x) = X ~ 1 < and g\x) = % > 0. 
x 2 \/l — x 2 v 1 — X 2 

Putting all these facts together, we deduce that y\ < y. Finally, noticing that g is convex 
and remembering that X\ < y\ with (xi,yi) G P4, one must have (see Figure 4) 

[2 ^ 



|(xi,j/i)-(a,a)| <|(y,y)-(a,a)| =1 ~Y3 < 4- 

This later inequality, together with Lemma 2.5, implies that (16) holds for some fcGN. By 
a similar argumentation to the the proof of Theorem 2.9, one has either (x^+i, Vk+i) £ -Pi or 

(x k +2,yk+2) e Pi- □ 

We are finally ready to prove our main result. 

Proof of Theorem 2.1. Thanks to Lemma 2.5, Lemma 2.6, Corollary 2.10 and Corollary 2.11, 
we may assume without loss of generality that (xq, yo) G Pi (observe that in the region P 4 
the distance to the point (a, a) does not increase, while in the region P 5 the x-coordinate 
increases); see the left picture in Figure 5. Then Theorem 2.9 applies, and there is some 
m G N such that (x m ,y m ) G P±. Moreover, inequality (14) holds for all k < m. Since 
7 3 /4 < 1, the sequence generated by the Douglas- Rachford iteration (3) must converge to 
the point (a, a). □ 

16 



(x,y))(---' y (y,y) 



(a,a) 




Figure 4: The point (xx,yi) lies inside the dotted triangle. 



Remark 2.12. In fact we have shown the convergence of the algorithm in a bigger region: 
if either (x ,y ) E P\, or (x ,y ) G Pa with (x — a) 2 + (y — a) 2 < (e — a) 2 + (Vl — e 2 — a) 2 , 
for e :— (l — 2~ x / 3 ) , see the picture in the left in Figure 5. 




0.2 0.4 0.6 0.8 1 1.2 1.4 



Figure 5: The picture in the left shows the regions of convergence in Theorem 2.1 for the 
Douglas-Rachford algorithm. The picture in the right illustrates an example of a convergent 
sequence generated by the algorithm. 

Finally, recalling Proposition 2.8, Theorem 2.9, Corollary 2.10 and Corollary 2.11, we 
can exhibit a more general dichotomy. 
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Corollary 2.13. Given (xojZ/o) £ ^ 2 with Xq > 0, consider the sequence generated by 
the Douglas- Rachford scheme (3). Then, either the iteration visits Pq infinitely often or it 
converges to the point (a, a). 

Of course we believe the first case never occurs. 
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